2021-05-01 02:59

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: reuse-mess-6
SDF version: reuse-mess-6

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	595726	0.36%	26.53%	333073
Java	1443909	0.00%	18.92%	849158
WebDSL	246661	0.06%	18.79%	99696
SDF3	96607	1.01%	41.88%	50364

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	15468	99.01%	0.75%	1210	1744	0.94%	76.18%	0.00%	18.03%	5.79%
Java	35575	98.78%	0.99%	2836	3773	1.16%	85.65%	0.00%	4.06%	10.29%
WebDSL	5467	99.33%	0.36%	514	810	0.59%	56.34%	0.00%	37.93%	5.73%
SDF3	5363	98.91%	0.89%	281	649	1.06%	86.54%	0.00%	12.11%	1.34%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1443909	0.00%	18.92%	849158
StringUtils	571226	0.00%	15.07%	396935
gson	2305879	0.00%	23.22%	1267956
slf4j	1454623	0.00%	18.47%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	35575	98.78%	0.99%	2836	3773	1.16%	85.65%	0.00%	4.06%	10.29%
StringUtils	85266	96.59%	2.79%	6315	8461	3.26%	89.74%	0.00%	3.48%	6.78%
gson	5712	99.95%	0.04%	732	484	0.05%	85.64%	0.00%	2.94%	11.42%
slf4j	15748	99.79%	0.14%	1462	2375	0.18%	81.55%	0.00%	5.78%	12.67%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	571226	0 (0.00%)	86081 (15.07%)	396935

0	571555	0 (0.00%)	86079 (15.06%)	397077
1	570897	0 (0.00%)	86083 (15.08%)	396792
2	570913	0 (0.00%)	86059 (15.07%)	396796

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	85266	551769 (96.59%)	15951 (2.79%)	6315	8461	18623 (3.26%)	16653 (89.74%)	0 (0.00%)	706 (3.48%)	1264 (6.78%)
-> 0	1050282			0	397078
0 -> 1	106128	547823 (95.85%)	18641 (3.26%)	7561	9539	22164 (3.88%)	19518 (88.06%)	0 (0.00%)	1135 (5.12%)	1511 (6.82%)
1 -> 2	64403	555714 (97.34%)	13260 (2.32%)	5068	7382	15081 (2.64%)	13788 (91.43%)	0 (0.00%)	277 (1.84%)	1016 (6.74%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2305879	0 (0.00%)	535339 (23.22%)	1267956

0	2305749	0 (0.00%)	535313 (23.22%)	1267874
1	2306009	0 (0.00%)	535365 (23.22%)	1268038
2	2306176	0 (0.00%)	535403 (23.22%)	1268122

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	5712	2304671 (99.95%)	942 (0.04%)	732	484	1210 (0.05%)	1037 (85.64%)	0 (0.00%)	36 (2.94%)	138 (11.42%)
-> 0	6379840			0	1268079
0 -> 1	5742	2304563 (99.95%)	971 (0.04%)	668	535	1188 (0.05%)	1003 (84.43%)	0 (0.00%)	37 (3.11%)	148 (12.46%)
1 -> 2	5682	2304779 (99.95%)	913 (0.04%)	795	432	1232 (0.05%)	1070 (86.85%)	0 (0.00%)	34 (2.76%)	128 (10.39%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1454623	0 (0.00%)	268702 (18.47%)	882583

0	1453298	0 (0.00%)	268522 (18.48%)	881618
1	1455947	0 (0.00%)	268881 (18.47%)	883547
2	1455688	0 (0.00%)	268813 (18.47%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	15748	1451500 (99.79%)	2059 (0.14%)	1462	2375	2591 (0.18%)	2112 (81.55%)	0 (0.00%)	151 (5.78%)	328 (12.67%)
-> 0	3421848			0	881857
0 -> 1	18151	1450383 (99.80%)	2030 (0.14%)	1444	3246	2531 (0.17%)	2107 (83.25%)	0 (0.00%)	91 (3.60%)	333 (13.16%)
1 -> 2	13344	1452616 (99.77%)	2087 (0.14%)	1480	1504	2651 (0.18%)	2117 (79.86%)	0 (0.00%)	211 (7.96%)	323 (12.18%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246661	0.06%	18.79%	99696
YellowGrass	391440	0.07%	17.81%	159241
elib-utils	101881	0.05%	19.78%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	5467	99.33%	0.36%	514	810	0.59%	56.34%	0.00%	37.93%	5.73%
YellowGrass	7840	99.49%	0.41%	592	1091	0.50%	69.45%	0.00%	20.72%	9.83%
elib-utils	3094	99.18%	0.32%	436	529	0.67%	43.24%	0.00%	55.14%	1.62%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391440	272 (0.07%)	69698 (17.81%)	159241

0	391488	272 (0.07%)	69698 (17.80%)	159255
1	391392	272 (0.07%)	69698 (17.81%)	159227
2	393245	272 (0.07%)	70053 (17.81%)	159948

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	7840	389432 (99.49%)	1594 (0.41%)	592	1091	1970 (0.50%)	1485 (69.45%)	0 (0.00%)	331 (20.72%)	155 (9.83%)
-> 0	684076			0	159307
0 -> 1	7938	388887 (99.34%)	2249 (0.57%)	180	990	2434 (0.62%)	2302 (94.58%)	0 (0.00%)	98 (4.03%)	34 (1.40%)
1 -> 2	7742	389977 (99.64%)	939 (0.24%)	1004	1192	1505 (0.38%)	667 (44.32%)	0 (0.00%)	563 (37.41%)	275 (18.27%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	20154 (19.78%)	40151

0	101002	48 (0.05%)	20046 (19.85%)	39821
1	102759	48 (0.05%)	20262 (19.72%)	40480
2	103029	48 (0.05%)	20322 (19.72%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3094	101046 (99.18%)	319 (0.32%)	436	529	682 (0.67%)	373 (43.24%)	0 (0.00%)	306 (55.14%)	3 (1.62%)
-> 0	181055			0	39838
0 -> 1	5185	99545 (98.56%)	567 (0.56%)	751	900	1178 (1.17%)	694 (58.91%)	0 (0.00%)	484 (41.09%)	0 (0.00%)
1 -> 2	1002	102547 (99.79%)	71 (0.07%)	120	158	185 (0.18%)	51 (27.57%)	0 (0.00%)	128 (69.19%)	6 (3.24%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	96607	1.01%	41.88%	50364
NaBL	197571	0.87%	39.76%	100109
DynSem	21531	1.22%	40.38%	10138
FlowSpec	27218	1.06%	47.66%	13760
WebDSL	162860	1.14%	41.38%	86161
Java	73854	0.76%	40.24%	41650

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	5363	98.91%	0.89%	281	649	1.06%	86.54%	0.00%	12.11%	1.34%
NaBL	15245	98.73%	1.02%	794	1526	1.14%	94.69%	0.00%	3.37%	1.94%
DynSem	2236	98.33%	1.29%	122	284	1.67%	85.26%	0.00%	13.37%	1.38%
FlowSpec	3480	98.48%	1.25%	95	487	1.50%	79.76%	0.00%	18.49%	1.75%
WebDSL	5011	99.29%	0.65%	281	843	0.71%	95.45%	0.00%	3.95%	0.61%
Java	844	99.72%	0.24%	111	103	0.27%	77.56%	0.00%	21.38%	1.05%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	197571	1717 (0.87%)	78552 (39.76%)	100109

0	197569	1717 (0.87%)	78553 (39.76%)	100108
1	197573	1717 (0.87%)	78551 (39.76%)	100110
2	197557	1717 (0.87%)	78553 (39.76%)	100104

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	15245	195071 (98.73%)	2010 (1.02%)	794	1526	2245 (1.14%)	2126 (94.69%)	0 (0.00%)	76 (3.37%)	44 (1.94%)
-> 0	527151			0	100235
0 -> 1	15043	195168 (98.78%)	2029 (1.03%)	795	1470	2256 (1.14%)	2151 (95.35%)	0 (0.00%)	60 (2.66%)	45 (1.99%)
1 -> 2	15447	194973 (98.68%)	1991 (1.01%)	792	1582	2233 (1.13%)	2100 (94.04%)	0 (0.00%)	91 (4.08%)	42 (1.88%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	8694 (40.38%)	10138

0	21312	259 (1.22%)	8602 (40.36%)	10027
1	21750	267 (1.23%)	8785 (40.39%)	10248
2	21750	267 (1.23%)	8785 (40.39%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2236	21171 (98.33%)	278 (1.29%)	122	284	359 (1.67%)	303 (85.26%)	0 (0.00%)	50 (13.37%)	6 (1.38%)
-> 0	56142			0	10031
0 -> 1	2943	20903 (98.08%)	315 (1.48%)	152	396	413 (1.94%)	332 (80.39%)	0 (0.00%)	71 (17.19%)	10 (2.42%)
1 -> 2	1528	21439 (98.57%)	240 (1.10%)	92	172	304 (1.40%)	274 (90.13%)	0 (0.00%)	29 (9.54%)	1 (0.33%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	12973 (47.66%)	13760

0	26820	283 (1.06%)	12790 (47.69%)	13540
1	27616	295 (1.07%)	13156 (47.64%)	13980
2	28023	295 (1.05%)	13267 (47.34%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3480	26809 (98.48%)	337 (1.25%)	95	487	404 (1.50%)	339 (79.76%)	0 (0.00%)	58 (18.49%)	8 (1.75%)
-> 0	77718			0	13560
0 -> 1	5218	26220 (97.76%)	530 (1.98%)	98	693	612 (2.28%)	536 (87.58%)	0 (0.00%)	64 (10.46%)	12 (1.96%)
1 -> 2	1741	27397 (99.21%)	143 (0.52%)	92	280	196 (0.71%)	141 (71.94%)	0 (0.00%)	52 (26.53%)	3 (1.53%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	162860	1864 (1.14%)	67390 (41.38%)	86161

0	162878	1864 (1.14%)	67403 (41.38%)	86167
1	162841	1864 (1.14%)	67376 (41.38%)	86154
2	163063	1868 (1.15%)	67436 (41.36%)	86285

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	5011	161697 (99.29%)	1065 (0.65%)	281	843	1150 (0.71%)	1110 (95.45%)	0 (0.00%)	35 (3.95%)	6 (0.61%)
-> 0	424536			0	86193
0 -> 1	7925	160924 (98.80%)	1789 (1.10%)	450	1285	1926 (1.18%)	1869 (97.04%)	0 (0.00%)	49 (2.54%)	8 (0.42%)
1 -> 2	2097	162469 (99.77%)	341 (0.21%)	111	401	374 (0.23%)	351 (93.85%)	0 (0.00%)	20 (5.35%)	3 (0.80%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	73854	559 (0.76%)	29718 (40.24%)	41650

0	73857	559 (0.76%)	29718 (40.24%)	41651
1	73851	559 (0.76%)	29718 (40.24%)	41649
2	73852	559 (0.76%)	29718 (40.24%)	41649

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	844	73651 (99.72%)	179 (0.24%)	111	103	203 (0.27%)	160 (77.56%)	0 (0.00%)	40 (21.38%)	3 (1.05%)
-> 0	197675			0	41712
0 -> 1	1089	73616 (99.67%)	206 (0.28%)	114	122	237 (0.32%)	204 (86.08%)	0 (0.00%)	28 (11.81%)	5 (2.11%)
1 -> 2	598	73685 (99.78%)	151 (0.20%)	107	83	168 (0.23%)	116 (69.05%)	0 (0.00%)	52 (30.95%)	0 (0.00%)